

<!DOCTYPE html>
<html class="writer-html5" lang="zh" >
<head>
  <meta charset="utf-8">
  
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  
  <title>索引 &mdash; Scrapy 2.3.0 文档</title>
  

  
  <link rel="stylesheet" href="_static/css/theme.css" type="text/css" />
  <link rel="stylesheet" href="_static/pygments.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster.custom.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster.bundle.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster-sideTip-shadow.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster-sideTip-punk.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster-sideTip-noir.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster-sideTip-light.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/tooltipster-sideTip-borderless.min.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/micromodal.css" type="text/css" />
  <link rel="stylesheet" href="_static/css/sphinx_rtd_theme.css" type="text/css" />

  
  
  
  

  
  <!--[if lt IE 9]>
    <script src="_static/js/html5shiv.min.js"></script>
  <![endif]-->
  
    
      <script type="text/javascript" id="documentation_options" data-url_root="./" src="_static/documentation_options.js"></script>
        <script src="_static/jquery.js"></script>
        <script src="_static/underscore.js"></script>
        <script src="_static/doctools.js"></script>
        <script src="_static/language_data.js"></script>
        <script src="_static/js/hoverxref.js"></script>
        <script src="_static/js/tooltipster.bundle.min.js"></script>
        <script src="_static/js/micromodal.min.js"></script>
    
    <script type="text/javascript" src="_static/js/theme.js"></script>

    
    <link rel="index" title="索引" href="#" />
    <link rel="search" title="搜索" href="search.html" /> 
</head>

<body class="wy-body-for-nav">

   
  <div class="wy-grid-for-nav">
    
    <nav data-toggle="wy-nav-shift" class="wy-nav-side">
      <div class="wy-side-scroll">
        <div class="wy-side-nav-search" >
          

          
            <a href="index.html" class="icon icon-home" alt="Documentation Home"> Scrapy
          

          
          </a>

          
            
            
              <div class="version">
                2.3
              </div>
            
          

          
<div role="search">
  <form id="rtd-search-form" class="wy-form" action="search.html" method="get">
    <input type="text" name="q" placeholder="Search docs" />
    <input type="hidden" name="check_keywords" value="yes" />
    <input type="hidden" name="area" value="default" />
  </form>
</div>

          
        </div>

        
        <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
          
            
            
              
            
            
              <p class="caption"><span class="caption-text">第一步</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="intro/overview.html">Scrapy一目了然</a></li>
<li class="toctree-l1"><a class="reference internal" href="intro/install.html">安装指南</a></li>
<li class="toctree-l1"><a class="reference internal" href="intro/tutorial.html">Scrapy 教程</a></li>
<li class="toctree-l1"><a class="reference internal" href="intro/examples.html">实例</a></li>
</ul>
<p class="caption"><span class="caption-text">基本概念</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="topics/commands.html">命令行工具</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/spiders.html">蜘蛛</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/selectors.html">选择器</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/items.html">项目</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/loaders.html">项目加载器</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/shell.html">Scrapy shell</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/item-pipeline.html">项目管道</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/feed-exports.html">Feed 导出</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/request-response.html">请求和响应</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/link-extractors.html">链接提取器</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/settings.html">设置</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/exceptions.html">例外情况</a></li>
</ul>
<p class="caption"><span class="caption-text">内置服务</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="topics/logging.html">登录</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/stats.html">统计数据集合</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/email.html">发送电子邮件</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/telnetconsole.html">远程登录控制台</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/webservice.html">Web服务</a></li>
</ul>
<p class="caption"><span class="caption-text">解决具体问题</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="faq.html">常见问题</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/debug.html">调试spiders</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/contracts.html">蜘蛛合约</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/practices.html">常用做法</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/broad-crawls.html">宽爬行</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/developer-tools.html">使用浏览器的开发人员工具进行抓取</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/dynamic-content.html">选择动态加载的内容</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/leaks.html">调试内存泄漏</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/media-pipeline.html">下载和处理文件和图像</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/deploy.html">部署蜘蛛</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/autothrottle.html">AutoThrottle 扩展</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/benchmarking.html">标杆管理</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/jobs.html">作业：暂停和恢复爬行</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/coroutines.html">协同程序</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/asyncio.html">asyncio</a></li>
</ul>
<p class="caption"><span class="caption-text">扩展Scrapy</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="topics/architecture.html">体系结构概述</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/downloader-middleware.html">下载器中间件</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/spider-middleware.html">蜘蛛中间件</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/extensions.html">扩展</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/api.html">核心API</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/signals.html">信号</a></li>
<li class="toctree-l1"><a class="reference internal" href="topics/exporters.html">条目导出器</a></li>
</ul>
<p class="caption"><span class="caption-text">其余所有</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="news.html">发行说明</a></li>
<li class="toctree-l1"><a class="reference internal" href="contributing.html">为 Scrapy 贡献</a></li>
<li class="toctree-l1"><a class="reference internal" href="versioning.html">版本控制和API稳定性</a></li>
</ul>

            
          
        </div>
        
      </div>
    </nav>

    <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">

      
      <nav class="wy-nav-top" aria-label="top navigation">
        
          <i data-toggle="wy-nav-top" class="fa fa-bars"></i>
          <a href="index.html">Scrapy</a>
        
      </nav>


      <div class="wy-nav-content">
        
        <div class="rst-content">
        
          















<div role="navigation" aria-label="breadcrumbs navigation">

  <ul class="wy-breadcrumbs">
    
      <li><a href="index.html" class="icon icon-home"></a> &raquo;</li>
        
      <li>索引</li>
    
    
      <li class="wy-breadcrumbs-aside">
        
            
        
      </li>
    
  </ul>

  
  <hr/>
</div>
          <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
           <div itemprop="articleBody">
            

<h1 id="index">索引</h1><script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script>
<ins class="adsbygoogle"
     style="display:block; text-align:center;"
     data-ad-layout="in-article"
     data-ad-format="fluid"
     data-ad-client="ca-pub-1466963416408457"
     data-ad-slot="8850786025"></ins>
<script>
     (adsbygoogle = window.adsbygoogle || []).push({});
</script>

<div class="genindex-jumpbox">
 <a href="#_"><strong>_</strong></a>
 | <a href="#A"><strong>A</strong></a>
 | <a href="#B"><strong>B</strong></a>
 | <a href="#C"><strong>C</strong></a>
 | <a href="#D"><strong>D</strong></a>
 | <a href="#E"><strong>E</strong></a>
 | <a href="#F"><strong>F</strong></a>
 | <a href="#G"><strong>G</strong></a>
 | <a href="#H"><strong>H</strong></a>
 | <a href="#I"><strong>I</strong></a>
 | <a href="#J"><strong>J</strong></a>
 | <a href="#L"><strong>L</strong></a>
 | <a href="#M"><strong>M</strong></a>
 | <a href="#N"><strong>N</strong></a>
 | <a href="#O"><strong>O</strong></a>
 | <a href="#P"><strong>P</strong></a>
 | <a href="#Q"><strong>Q</strong></a>
 | <a href="#R"><strong>R</strong></a>
 | <a href="#S"><strong>S</strong></a>
 | <a href="#T"><strong>T</strong></a>
 | <a href="#U"><strong>U</strong></a>
 | <a href="#V"><strong>V</strong></a>
 | <a href="#X"><strong>X</strong></a>
 | <a href="#模"><strong>模</strong></a>
 
</div>
<h2 id="_">_</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.__bool__">__bool__() (scrapy.selector.Selector 方法)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="A">A</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.adapt_response">adapt_response() (scrapy.spiders.XMLFeedSpider 方法)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.contracts.Contract.adjust_request_args">adjust_request_args() (scrapy.contracts.Contract 方法)</a>
</li>
      <li>
    AJAXCRAWL_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-AJAXCRAWL_ENABLED">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware">AjaxCrawlMiddleware (scrapy.downloadermiddlewares.ajaxcrawl 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.robotstxt.RobotParser.allowed">allowed() (scrapy.robotstxt.RobotParser 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.allowed_domains">allowed_domains (scrapy.spiders.Spider 属性)</a>
</li>
      <li>
    ASYNCIO_EVENT_LOOP

      <ul>
        <li><a href="topics/settings.html#std-setting-ASYNCIO_EVENT_LOOP">setting</a>
</li>
      </ul></li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.attrib">attrib (scrapy.selector.Selector 属性)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.attrib">(scrapy.selector.SelectorList 属性)</a>
</li>
      </ul></li>
      <li>
    AUTOTHROTTLE_DEBUG

      <ul>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_DEBUG">setting</a>
</li>
      </ul></li>
      <li>
    AUTOTHROTTLE_ENABLED

      <ul>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    AUTOTHROTTLE_MAX_DELAY

      <ul>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_MAX_DELAY">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    AUTOTHROTTLE_START_DELAY

      <ul>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_START_DELAY">setting</a>
</li>
      </ul></li>
      <li>
    AUTOTHROTTLE_TARGET_CONCURRENCY

      <ul>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_TARGET_CONCURRENCY">setting</a>
</li>
      </ul></li>
      <li>
    AWS_ACCESS_KEY_ID

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_ACCESS_KEY_ID">setting</a>
</li>
      </ul></li>
      <li>
    AWS_ENDPOINT_URL

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_ENDPOINT_URL">setting</a>
</li>
      </ul></li>
      <li>
    AWS_REGION_NAME

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_REGION_NAME">setting</a>
</li>
      </ul></li>
      <li>
    AWS_SECRET_ACCESS_KEY

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_SECRET_ACCESS_KEY">setting</a>
</li>
      </ul></li>
      <li>
    AWS_USE_SSL

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_USE_SSL">setting</a>
</li>
      </ul></li>
      <li>
    AWS_VERIFY

      <ul>
        <li><a href="topics/settings.html#std-setting-AWS_VERIFY">setting</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="B">B</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter">BaseItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings">BaseSettings (scrapy.settings 中的类)</a>
</li>
      <li>
    bench

      <ul>
        <li><a href="topics/commands.html#std-command-bench">command</a>
</li>
      </ul></li>
      <li>
    bindaddress

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-bindaddress">reqmeta</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/request-response.html#scrapy.http.Request.body">body (scrapy.http.Request 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.body">(scrapy.http.Response 属性)</a>
</li>
      </ul></li>
      <li>
    BOT_NAME

      <ul>
        <li><a href="topics/settings.html#std-setting-BOT_NAME">setting</a>
</li>
      </ul></li>
      <li>
    bytes_received

      <ul>
        <li><a href="topics/signals.html#std-signal-bytes_received">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.bytes_received">bytes_received() (在 scrapy.signals 模块中)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="C">C</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.CacheStorage">CacheStorage (scrapy.extensions.httpcache 中的类)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.contracts.default.CallbackKeywordArgumentsContract">CallbackKeywordArgumentsContract (scrapy.contracts.default 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Request.cb_kwargs">cb_kwargs (scrapy.http.Request 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.cb_kwargs">(scrapy.http.Response 属性)</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Response.certificate">certificate (scrapy.http.Response 属性)</a>
</li>
      <li>
    check

      <ul>
        <li><a href="topics/commands.html#std-command-check">command</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.clear_stats">clear_stats() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/item-pipeline.html#close_spider">close_spider()</a>

      <ul>
        <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.CacheStorage.close_spider">(scrapy.extensions.httpcache.CacheStorage 方法)</a>
</li>
        <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.close_spider">(scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.closed">closed() (scrapy.spiders.Spider 方法)</a>
</li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.CloseSpider">CloseSpider</a>

      <ul>
        <li><a href="topics/extensions.html#scrapy.extensions.closespider.CloseSpider">(scrapy.extensions.closespider 中的类)</a>
</li>
      </ul></li>
      <li>
    CLOSESPIDER_ERRORCOUNT

      <ul>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_ERRORCOUNT">setting</a>
</li>
      </ul></li>
      <li>
    CLOSESPIDER_ITEMCOUNT

      <ul>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_ITEMCOUNT">setting</a>
</li>
      </ul></li>
      <li>
    CLOSESPIDER_PAGECOUNT

      <ul>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_PAGECOUNT">setting</a>
</li>
      </ul></li>
      <li>
    CLOSESPIDER_TIMEOUT

      <ul>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_TIMEOUT">setting</a>
</li>
      </ul></li>
      <li>
    command

      <ul>
        <li><a href="topics/commands.html#std-command-bench">bench</a>
</li>
        <li><a href="topics/commands.html#std-command-check">check</a>
</li>
        <li><a href="topics/commands.html#std-command-crawl">crawl</a>
</li>
        <li><a href="topics/commands.html#std-command-edit">edit</a>
</li>
        <li><a href="topics/commands.html#std-command-fetch">fetch</a>
</li>
        <li><a href="topics/commands.html#std-command-genspider">genspider</a>
</li>
        <li><a href="topics/commands.html#std-command-list">list</a>
</li>
        <li><a href="topics/commands.html#std-command-parse">parse</a>
</li>
        <li><a href="topics/commands.html#std-command-runspider">runspider</a>
</li>
        <li><a href="topics/commands.html#std-command-settings">settings</a>
</li>
        <li><a href="topics/commands.html#std-command-shell">shell</a>
</li>
        <li><a href="topics/commands.html#std-command-startproject">startproject</a>
</li>
        <li><a href="topics/commands.html#std-command-version">version</a>
</li>
        <li><a href="topics/commands.html#std-command-view">view</a>
</li>
      </ul></li>
      <li>
    COMMANDS_MODULE

      <ul>
        <li><a href="topics/commands.html#std-setting-COMMANDS_MODULE">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    COMPRESSION_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-COMPRESSION_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    CONCURRENT_ITEMS

      <ul>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_ITEMS">setting</a>
</li>
      </ul></li>
      <li>
    CONCURRENT_REQUESTS

      <ul>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS">setting</a>
</li>
      </ul></li>
      <li>
    CONCURRENT_REQUESTS_PER_DOMAIN

      <ul>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS_PER_DOMAIN">setting</a>
</li>
      </ul></li>
      <li>
    CONCURRENT_REQUESTS_PER_IP

      <ul>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS_PER_IP">setting</a>
</li>
      </ul></li>
      <li><a href="topics/contracts.html#scrapy.contracts.Contract">Contract (scrapy.contracts 中的类)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.exceptions.ContractFail">ContractFail (scrapy.exceptions 中的类)</a>
</li>
      <li>
    cookiejar

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-cookiejar">reqmeta</a>
</li>
      </ul></li>
      <li>
    COOKIES_DEBUG

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-COOKIES_DEBUG">setting</a>
</li>
      </ul></li>
      <li>
    COOKIES_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-COOKIES_ENABLED">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.cookies.CookiesMiddleware">CookiesMiddleware (scrapy.downloadermiddlewares.cookies 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Request.copy">copy() (scrapy.http.Request 方法)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.copy">(scrapy.http.Response 方法)</a>
</li>
        <li><a href="topics/items.html#scrapy.item.Item.copy">(scrapy.item.Item 方法)</a>
</li>
        <li><a href="topics/api.html#scrapy.settings.BaseSettings.copy">(scrapy.settings.BaseSettings 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.copy_to_dict">copy_to_dict() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.corestats.CoreStats">CoreStats (scrapy.extensions.corestats 中的类)</a>
</li>
      <li>
    crawl

      <ul>
        <li><a href="topics/commands.html#std-command-crawl">command</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.crawl">crawl() (scrapy.crawler.Crawler 方法)</a>
</li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.crawled">crawled() (scrapy.logformatter.LogFormatter 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler">Crawler (scrapy.crawler 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.crawler">crawler (scrapy.spiders.Spider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.CrawlSpider">CrawlSpider (scrapy.spiders 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse.css">css() (scrapy.http.TextResponse 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.Selector.css">(scrapy.selector.Selector 方法)</a>
</li>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.css">(scrapy.selector.SelectorList 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/spiders.html#scrapy.spiders.CSVFeedSpider">CSVFeedSpider (scrapy.spiders 中的类)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.CsvItemExporter">CsvItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/developer-tools.html#scrapy.utils.curl.curl_to_request_kwargs">curl_to_request_kwargs() (在 scrapy.utils.curl 模块中)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.custom_settings">custom_settings (scrapy.spiders.Spider 属性)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="D">D</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.DbmCacheStorage">DbmCacheStorage (scrapy.extensions.httpcache 中的类)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.debug.Debugger">Debugger (scrapy.extensions.debug 中的类)</a>
</li>
      <li><a href="topics/items.html#scrapy.item.Item.deepcopy">deepcopy() (scrapy.item.Item 方法)</a>
</li>
      <li>
    DEFAULT_ITEM_CLASS

      <ul>
        <li><a href="topics/settings.html#std-setting-DEFAULT_ITEM_CLASS">setting</a>
</li>
      </ul></li>
      <li>
    DEFAULT_REQUEST_HEADERS

      <ul>
        <li><a href="topics/settings.html#std-setting-DEFAULT_REQUEST_HEADERS">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware">DefaultHeadersMiddleware (scrapy.downloadermiddlewares.defaultheaders 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.DefaultReferrerPolicy">DefaultReferrerPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.CSVFeedSpider.delimiter">delimiter (scrapy.spiders.CSVFeedSpider 属性)</a>
</li>
      <li>
    DEPTH_LIMIT

      <ul>
        <li><a href="topics/settings.html#std-setting-DEPTH_LIMIT">setting</a>
</li>
      </ul></li>
      <li>
    DEPTH_PRIORITY

      <ul>
        <li><a href="topics/settings.html#std-setting-DEPTH_PRIORITY">setting</a>
</li>
      </ul></li>
      <li>
    DEPTH_STATS_VERBOSE

      <ul>
        <li><a href="topics/settings.html#std-setting-DEPTH_STATS_VERBOSE">setting</a>
</li>
      </ul></li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.depth.DepthMiddleware">DepthMiddleware (scrapy.spidermiddlewares.depth 中的类)</a>
</li>
      <li>
    DNS_RESOLVER

      <ul>
        <li><a href="topics/settings.html#std-setting-DNS_RESOLVER">setting</a>
</li>
      </ul></li>
      <li>
    DNS_TIMEOUT

      <ul>
        <li><a href="topics/settings.html#std-setting-DNS_TIMEOUT">setting</a>
</li>
      </ul></li>
      <li>
    DNSCACHE_ENABLED

      <ul>
        <li><a href="topics/settings.html#std-setting-DNSCACHE_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    DNSCACHE_SIZE

      <ul>
        <li><a href="topics/settings.html#std-setting-DNSCACHE_SIZE">setting</a>
</li>
      </ul></li>
      <li>
    dont_cache

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_cache">reqmeta</a>
</li>
      </ul></li>
      <li>
    dont_merge_cookies

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-dont_merge_cookies">reqmeta</a>
</li>
      </ul></li>
      <li>
    dont_obey_robotstxt

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_obey_robotstxt">reqmeta</a>
</li>
      </ul></li>
      <li>
    dont_redirect

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_redirect">reqmeta</a>
</li>
      </ul></li>
      <li>
    dont_retry

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_retry">reqmeta</a>
</li>
      </ul></li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.DontCloseSpider">DontCloseSpider</a>
</li>
      <li>
    DOWNLOAD_DELAY

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_DELAY">setting</a>
</li>
      </ul></li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.download_error">download_error() (scrapy.logformatter.LogFormatter 方法)</a>
</li>
      <li>
    DOWNLOAD_FAIL_ON_DATALOSS

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_FAIL_ON_DATALOSS">setting</a>
</li>
      </ul></li>
      <li>
    download_fail_on_dataloss

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-download_fail_on_dataloss">reqmeta</a>
</li>
      </ul></li>
      <li>
    DOWNLOAD_HANDLERS

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_HANDLERS">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    DOWNLOAD_HANDLERS_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_HANDLERS_BASE">setting</a>
</li>
      </ul></li>
      <li>
    download_latency

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-download_latency">reqmeta</a>
</li>
      </ul></li>
      <li>
    DOWNLOAD_MAXSIZE

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_MAXSIZE">setting</a>
</li>
      </ul></li>
      <li>
    download_maxsize

      <ul>
        <li><a href="topics/settings.html#std-reqmeta-download_maxsize">reqmeta</a>
</li>
      </ul></li>
      <li>
    DOWNLOAD_TIMEOUT

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_TIMEOUT">setting</a>
</li>
      </ul></li>
      <li>
    download_timeout

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-download_timeout">reqmeta</a>
</li>
      </ul></li>
      <li>
    DOWNLOAD_WARNSIZE

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_WARNSIZE">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_CLIENT_TLS_CIPHERS

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_CIPHERS">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_CLIENT_TLS_METHOD

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_METHOD">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_CLIENTCONTEXTFACTORY

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENTCONTEXTFACTORY">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_HTTPCLIENTFACTORY

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_HTTPCLIENTFACTORY">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_MIDDLEWARES

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_MIDDLEWARES">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_MIDDLEWARES_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_MIDDLEWARES_BASE">setting</a>
</li>
      </ul></li>
      <li>
    DOWNLOADER_STATS

      <ul>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_STATS">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.DownloaderMiddleware">DownloaderMiddleware (scrapy.downloadermiddlewares 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.stats.DownloaderStats">DownloaderStats (scrapy.downloadermiddlewares.stats 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware">DownloadTimeoutMiddleware (scrapy.downloadermiddlewares.downloadtimeout 中的类)</a>
</li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.DropItem">DropItem</a>
</li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.dropped">dropped() (scrapy.logformatter.LogFormatter 方法)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.DummyPolicy">DummyPolicy (scrapy.extensions.httpcache 中的类)</a>
</li>
      <li><a href="topics/stats.html#scrapy.statscollectors.DummyStatsCollector">DummyStatsCollector (scrapy.statscollectors 中的类)</a>
</li>
      <li>
    DUPEFILTER_CLASS

      <ul>
        <li><a href="topics/settings.html#std-setting-DUPEFILTER_CLASS">setting</a>
</li>
      </ul></li>
      <li>
    DUPEFILTER_DEBUG

      <ul>
        <li><a href="topics/settings.html#std-setting-DUPEFILTER_DEBUG">setting</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="E">E</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    edit

      <ul>
        <li><a href="topics/commands.html#std-command-edit">command</a>
</li>
      </ul></li>
      <li>
    EDITOR

      <ul>
        <li><a href="topics/settings.html#std-setting-EDITOR">setting</a>
</li>
      </ul></li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.encoding">encoding (scrapy.exporters.BaseItemExporter 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.TextResponse.encoding">(scrapy.http.TextResponse 属性)</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.engine">engine (scrapy.crawler.Crawler 属性)</a>
</li>
      <li>
    engine_started

      <ul>
        <li><a href="topics/signals.html#std-signal-engine_started">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.engine_started">engine_started() (在 scrapy.signals 模块中)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    engine_stopped

      <ul>
        <li><a href="topics/signals.html#std-signal-engine_stopped">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.engine_stopped">engine_stopped() (在 scrapy.signals 模块中)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.export_empty_fields">export_empty_fields (scrapy.exporters.BaseItemExporter 属性)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.export_item">export_item() (scrapy.exporters.BaseItemExporter 方法)</a>
</li>
      <li>
    EXTENSIONS

      <ul>
        <li><a href="topics/settings.html#std-setting-EXTENSIONS">setting</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.extensions">extensions (scrapy.crawler.Crawler 属性)</a>
</li>
      <li>
    EXTENSIONS_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-EXTENSIONS_BASE">setting</a>
</li>
      </ul></li>
      <li><a href="topics/link-extractors.html#scrapy.linkextractors.lxmlhtml.LxmlLinkExtractor.extract_links">extract_links() (scrapy.linkextractors.lxmlhtml.LxmlLinkExtractor 方法)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="F">F</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    FEED_EXPORT_BATCH_ITEM_COUNT

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_BATCH_ITEM_COUNT">setting</a>
</li>
      </ul></li>
      <li>
    FEED_EXPORT_ENCODING

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_ENCODING">setting</a>
</li>
      </ul></li>
      <li>
    FEED_EXPORT_FIELDS

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_FIELDS">setting</a>
</li>
      </ul></li>
      <li>
    FEED_EXPORT_INDENT

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_INDENT">setting</a>
</li>
      </ul></li>
      <li>
    FEED_EXPORTERS

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORTERS">setting</a>
</li>
      </ul></li>
      <li>
    FEED_EXPORTERS_BASE

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORTERS_BASE">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORAGE_FTP_ACTIVE

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGE_FTP_ACTIVE">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORAGE_GCS_ACL

      <ul>
        <li><a href="topics/settings.html#std-setting-FEED_STORAGE_GCS_ACL">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORAGE_S3_ACL

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGE_S3_ACL">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORAGES

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGES">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORAGES_BASE

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGES_BASE">setting</a>
</li>
      </ul></li>
      <li>
    FEED_STORE_EMPTY

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORE_EMPTY">setting</a>
</li>
      </ul></li>
      <li>
    FEED_TEMPDIR

      <ul>
        <li><a href="topics/settings.html#std-setting-FEED_TEMPDIR">setting</a>
</li>
      </ul></li>
      <li>
    FEED_URI_PARAMS

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEED_URI_PARAMS">setting</a>
</li>
      </ul></li>
      <li>
    FEEDS

      <ul>
        <li><a href="topics/feed-exports.html#std-setting-FEEDS">setting</a>
</li>
      </ul></li>
      <li>
    fetch

      <ul>
        <li><a href="topics/commands.html#std-command-fetch">command</a>
</li>
      </ul></li>
      <li><a href="topics/items.html#scrapy.item.Field">Field (scrapy.item 中的类)</a>
</li>
      <li><a href="topics/items.html#scrapy.item.Item.fields">fields (scrapy.item.Item 属性)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.fields_to_export">fields_to_export (scrapy.exporters.BaseItemExporter 属性)</a>
</li>
      <li><a href="topics/media-pipeline.html#scrapy.pipelines.files.FilesPipeline.file_path">file_path() (scrapy.pipelines.files.FilesPipeline 方法)</a>

      <ul>
        <li><a href="topics/media-pipeline.html#scrapy.pipelines.images.ImagesPipeline.file_path">(scrapy.pipelines.images.ImagesPipeline 方法)</a>
</li>
      </ul></li>
      <li>
    FILES_EXPIRES

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_EXPIRES">setting</a>
</li>
      </ul></li>
      <li>
    FILES_RESULT_FIELD

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_RESULT_FIELD">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    FILES_STORE

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE">setting</a>
</li>
      </ul></li>
      <li>
    FILES_STORE_GCS_ACL

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE_GCS_ACL">setting</a>
</li>
      </ul></li>
      <li>
    FILES_STORE_S3_ACL

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE_S3_ACL">setting</a>
</li>
      </ul></li>
      <li>
    FILES_URLS_FIELD

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_URLS_FIELD">setting</a>
</li>
      </ul></li>
      <li><a href="topics/media-pipeline.html#scrapy.pipelines.files.FilesPipeline">FilesPipeline (scrapy.pipelines.files 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.FilesystemCacheStorage">FilesystemCacheStorage (scrapy.extensions.httpcache 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.spiderloader.SpiderLoader.find_by_request">find_by_request() (scrapy.spiderloader.SpiderLoader 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.finish_exporting">finish_exporting() (scrapy.exporters.BaseItemExporter 方法)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response.flags">flags (scrapy.http.Response 属性)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response.follow">follow() (scrapy.http.Response 方法)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.TextResponse.follow">(scrapy.http.TextResponse 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Response.follow_all">follow_all() (scrapy.http.Response 方法)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.TextResponse.follow_all">(scrapy.http.TextResponse 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.FormRequest">FormRequest (scrapy.http 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.freeze">freeze() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/item-pipeline.html#from_crawler">from_crawler()</a>

      <ul>
        <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.DownloaderMiddleware.from_crawler">(scrapy.downloadermiddlewares.DownloaderMiddleware 方法)</a>
</li>
        <li><a href="topics/downloader-middleware.html#scrapy.robotstxt.RobotParser.from_crawler">(scrapy.robotstxt.RobotParser 类方法)</a>
</li>
        <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware.from_crawler">(scrapy.spidermiddlewares.SpiderMiddleware 方法)</a>
</li>
        <li><a href="topics/spiders.html#scrapy.spiders.Spider.from_crawler">(scrapy.spiders.Spider 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Request.from_curl">from_curl() (scrapy.http.Request 类方法)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.FormRequest.from_response">from_response() (scrapy.http.FormRequest 类方法)</a>
</li>
      <li><a href="topics/email.html#scrapy.mail.MailSender.from_settings">from_settings() (scrapy.mail.MailSender 类方法)</a>

      <ul>
        <li><a href="topics/api.html#scrapy.spiderloader.SpiderLoader.from_settings">(scrapy.spiderloader.SpiderLoader 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.frozencopy">frozencopy() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li>
    FTP_PASSIVE_MODE

      <ul>
        <li><a href="topics/settings.html#std-setting-FTP_PASSIVE_MODE">setting</a>
</li>
      </ul></li>
      <li>
    FTP_PASSWORD

      <ul>
        <li><a href="topics/settings.html#std-setting-FTP_PASSWORD">setting</a>
</li>
      </ul></li>
      <li>
    ftp_password

      <ul>
        <li><a href="topics/settings.html#std-reqmeta-ftp_password">reqmeta</a>
</li>
      </ul></li>
      <li>
    FTP_USER

      <ul>
        <li><a href="topics/settings.html#std-setting-FTP_USER">setting</a>
</li>
      </ul></li>
      <li>
    ftp_user

      <ul>
        <li><a href="topics/settings.html#std-reqmeta-ftp_user">reqmeta</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="G">G</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    GCS_PROJECT_ID

      <ul>
        <li><a href="topics/settings.html#std-setting-GCS_PROJECT_ID">setting</a>
</li>
      </ul></li>
      <li>
    genspider

      <ul>
        <li><a href="topics/commands.html#std-command-genspider">command</a>
</li>
      </ul></li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.get">get() (scrapy.selector.Selector 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.get">(scrapy.selector.SelectorList 方法)</a>
</li>
        <li><a href="topics/api.html#scrapy.settings.BaseSettings.get">(scrapy.settings.BaseSettings 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/media-pipeline.html#scrapy.pipelines.files.FilesPipeline.get_media_requests">get_media_requests() (scrapy.pipelines.files.FilesPipeline 方法)</a>

      <ul>
        <li><a href="topics/media-pipeline.html#scrapy.pipelines.images.ImagesPipeline.get_media_requests">(scrapy.pipelines.images.ImagesPipeline 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/leaks.html#scrapy.utils.trackref.get_oldest">get_oldest() (在 scrapy.utils.trackref 模块中)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.get_settings_priority">get_settings_priority() (在 scrapy.settings 模块中)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.get_stats">get_stats() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.get_value">get_value() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.getall">getall() (scrapy.selector.Selector 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.getall">(scrapy.selector.SelectorList 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getbool">getbool() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getdict">getdict() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getfloat">getfloat() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getint">getint() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getlist">getlist() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getpriority">getpriority() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.getwithbase">getwithbase() (scrapy.settings.BaseSettings 方法)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="H">H</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    handle_httpstatus_all

      <ul>
        <li><a href="topics/spider-middleware.html#std-reqmeta-handle_httpstatus_all">reqmeta</a>
</li>
      </ul></li>
      <li>
    handle_httpstatus_list

      <ul>
        <li><a href="topics/spider-middleware.html#std-reqmeta-handle_httpstatus_list">reqmeta</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Request.headers">headers (scrapy.http.Request 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.headers">(scrapy.http.Response 属性)</a>
</li>
        <li><a href="topics/spiders.html#scrapy.spiders.CSVFeedSpider.headers">(scrapy.spiders.CSVFeedSpider 属性)</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.HtmlResponse">HtmlResponse (scrapy.http 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware">HttpAuthMiddleware (scrapy.downloadermiddlewares.httpauth 中的类)</a>
</li>
      <li>
    HTTPCACHE_ALWAYS_STORE

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_ALWAYS_STORE">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_DBM_MODULE

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_DBM_MODULE">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_DIR

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_DIR">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_EXPIRATION_SECS

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_EXPIRATION_SECS">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_GZIP

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_GZIP">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_IGNORE_HTTP_CODES

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_HTTP_CODES">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    HTTPCACHE_IGNORE_MISSING

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_MISSING">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_IGNORE_SCHEMES

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_SCHEMES">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_POLICY

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_POLICY">setting</a>
</li>
      </ul></li>
      <li>
    HTTPCACHE_STORAGE

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_STORAGE">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware">HttpCacheMiddleware (scrapy.downloadermiddlewares.httpcache 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware">HttpCompressionMiddleware (scrapy.downloadermiddlewares.httpcompression 中的类)</a>
</li>
      <li>
    HTTPERROR_ALLOW_ALL

      <ul>
        <li><a href="topics/spider-middleware.html#std-setting-HTTPERROR_ALLOW_ALL">setting</a>
</li>
      </ul></li>
      <li>
    HTTPERROR_ALLOWED_CODES

      <ul>
        <li><a href="topics/spider-middleware.html#std-setting-HTTPERROR_ALLOWED_CODES">setting</a>
</li>
      </ul></li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.httperror.HttpErrorMiddleware">HttpErrorMiddleware (scrapy.spidermiddlewares.httperror 中的类)</a>
</li>
      <li>
    HTTPPROXY_AUTH_ENCODING

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPPROXY_AUTH_ENCODING">setting</a>
</li>
      </ul></li>
      <li>
    HTTPPROXY_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPPROXY_ENABLED">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware">HttpProxyMiddleware (scrapy.downloadermiddlewares.httpproxy 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="I">I</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/exceptions.html#scrapy.exceptions.IgnoreRequest">IgnoreRequest</a>
</li>
      <li>
    IMAGES_EXPIRES

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_EXPIRES">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_MIN_HEIGHT

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_MIN_HEIGHT">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_MIN_WIDTH

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_MIN_WIDTH">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_RESULT_FIELD

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_RESULT_FIELD">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_STORE

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_STORE_GCS_ACL

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE_GCS_ACL">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_STORE_S3_ACL

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE_S3_ACL">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_THUMBS

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_THUMBS">setting</a>
</li>
      </ul></li>
      <li>
    IMAGES_URLS_FIELD

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_URLS_FIELD">setting</a>
</li>
      </ul></li>
      <li><a href="topics/media-pipeline.html#scrapy.pipelines.images.ImagesPipeline">ImagesPipeline (scrapy.pipelines.images 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.inc_value">inc_value() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.indent">indent (scrapy.exporters.BaseItemExporter 属性)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/settings.html#scrapy.utils.reactor.install_reactor">install_reactor() (在 scrapy.utils.reactor 模块中)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response.ip_address">ip_address (scrapy.http.Response 属性)</a>
</li>
      <li><a href="topics/items.html#scrapy.item.Item">Item (scrapy.item 中的类)</a>
</li>
      <li><a href="topics/media-pipeline.html#scrapy.pipelines.files.FilesPipeline.item_completed">item_completed() (scrapy.pipelines.files.FilesPipeline 方法)</a>

      <ul>
        <li><a href="topics/media-pipeline.html#scrapy.pipelines.images.ImagesPipeline.item_completed">(scrapy.pipelines.images.ImagesPipeline 方法)</a>
</li>
      </ul></li>
      <li>
    item_dropped

      <ul>
        <li><a href="topics/signals.html#std-signal-item_dropped">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.item_dropped">item_dropped() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    item_error

      <ul>
        <li><a href="topics/signals.html#std-signal-item_error">signal</a>
</li>
      </ul></li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.item_error">item_error() (scrapy.logformatter.LogFormatter 方法)</a>

      <ul>
        <li><a href="topics/signals.html#scrapy.signals.item_error">(在 scrapy.signals 模块中)</a>
</li>
      </ul></li>
      <li>
    ITEM_PIPELINES

      <ul>
        <li><a href="topics/settings.html#std-setting-ITEM_PIPELINES">setting</a>
</li>
      </ul></li>
      <li>
    ITEM_PIPELINES_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-ITEM_PIPELINES_BASE">setting</a>
</li>
      </ul></li>
      <li>
    item_scraped

      <ul>
        <li><a href="topics/signals.html#std-signal-item_scraped">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.item_scraped">item_scraped() (在 scrapy.signals 模块中)</a>
</li>
      <li><a href="topics/items.html#scrapy.item.ItemMeta">ItemMeta (scrapy.item 中的类)</a>
</li>
      <li><a href="topics/leaks.html#scrapy.utils.trackref.iter_all">iter_all() (在 scrapy.utils.trackref 模块中)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.iterator">iterator (scrapy.spiders.XMLFeedSpider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.itertag">itertag (scrapy.spiders.XMLFeedSpider 属性)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="J">J</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse.json">json() (scrapy.http.TextResponse 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.JsonItemExporter">JsonItemExporter (scrapy.exporters 中的类)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/exporters.html#scrapy.exporters.JsonLinesItemExporter">JsonLinesItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.JsonRequest">JsonRequest (scrapy.http 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="L">L</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/link-extractors.html#scrapy.link.Link">Link (scrapy.link 中的类)</a>
</li>
      <li>
    list

      <ul>
        <li><a href="topics/commands.html#std-command-list">command</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.spiderloader.SpiderLoader.list">list() (scrapy.spiderloader.SpiderLoader 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.spiderloader.SpiderLoader.load">load() (scrapy.spiderloader.SpiderLoader 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.log">log() (scrapy.spiders.Spider 方法)</a>
</li>
      <li>
    LOG_DATEFORMAT

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_DATEFORMAT">setting</a>
</li>
      </ul></li>
      <li>
    LOG_ENABLED

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    LOG_ENCODING

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_ENCODING">setting</a>
</li>
      </ul></li>
      <li>
    LOG_FILE

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_FILE">setting</a>
</li>
      </ul></li>
      <li>
    LOG_FORMAT

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_FORMAT">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    LOG_FORMATTER

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_FORMATTER">setting</a>
</li>
      </ul></li>
      <li>
    LOG_LEVEL

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_LEVEL">setting</a>
</li>
      </ul></li>
      <li>
    LOG_SHORT_NAMES

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_SHORT_NAMES">setting</a>
</li>
      </ul></li>
      <li>
    LOG_STDOUT

      <ul>
        <li><a href="topics/settings.html#std-setting-LOG_STDOUT">setting</a>
</li>
      </ul></li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter">LogFormatter (scrapy.logformatter 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.logger">logger (scrapy.spiders.Spider 属性)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.logstats.LogStats">LogStats (scrapy.extensions.logstats 中的类)</a>
</li>
      <li>
    LOGSTATS_INTERVAL

      <ul>
        <li><a href="topics/settings.html#std-setting-LOGSTATS_INTERVAL">setting</a>
</li>
      </ul></li>
      <li><a href="topics/link-extractors.html#scrapy.linkextractors.lxmlhtml.LxmlLinkExtractor">LxmlLinkExtractor (scrapy.linkextractors.lxmlhtml 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="M">M</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    MAIL_FROM

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_FROM">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_HOST

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_HOST">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_PASS

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_PASS">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_PORT

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_PORT">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_SSL

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_SSL">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_TLS

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_TLS">setting</a>
</li>
      </ul></li>
      <li>
    MAIL_USER

      <ul>
        <li><a href="topics/email.html#std-setting-MAIL_USER">setting</a>
</li>
      </ul></li>
      <li><a href="topics/email.html#scrapy.mail.MailSender">MailSender (scrapy.mail 中的类)</a>
</li>
      <li>
    max_retry_times

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-max_retry_times">reqmeta</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.max_value">max_value() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.maxpriority">maxpriority() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li>
    MEDIA_ALLOW_REDIRECTS

      <ul>
        <li><a href="topics/media-pipeline.html#std-setting-MEDIA_ALLOW_REDIRECTS">setting</a>
</li>
      </ul></li>
      <li>
    MEMDEBUG_ENABLED

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMDEBUG_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    MEMDEBUG_NOTIFY

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMDEBUG_NOTIFY">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/extensions.html#scrapy.extensions.memdebug.MemoryDebugger">MemoryDebugger (scrapy.extensions.memdebug 中的类)</a>
</li>
      <li><a href="topics/stats.html#scrapy.statscollectors.MemoryStatsCollector">MemoryStatsCollector (scrapy.statscollectors 中的类)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.memusage.MemoryUsage">MemoryUsage (scrapy.extensions.memusage 中的类)</a>
</li>
      <li>
    MEMUSAGE_CHECK_INTERVAL_SECONDS

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_CHECK_INTERVAL_SECONDS">setting</a>
</li>
      </ul></li>
      <li>
    MEMUSAGE_ENABLED

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    MEMUSAGE_LIMIT_MB

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_LIMIT_MB">setting</a>
</li>
      </ul></li>
      <li>
    MEMUSAGE_NOTIFY_MAIL

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_NOTIFY_MAIL">setting</a>
</li>
      </ul></li>
      <li>
    MEMUSAGE_WARNING_MB

      <ul>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_WARNING_MB">setting</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Request.meta">meta (scrapy.http.Request 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.meta">(scrapy.http.Response 属性)</a>
</li>
      </ul></li>
      <li>
    METAREFRESH_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    METAREFRESH_IGNORE_TAGS

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_IGNORE_TAGS">setting</a>
</li>
      </ul></li>
      <li>
    METAREFRESH_MAXDELAY

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_MAXDELAY">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware">MetaRefreshMiddleware (scrapy.downloadermiddlewares.redirect 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Request.method">method (scrapy.http.Request 属性)</a>
</li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.min_value">min_value() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="N">N</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.name">name (scrapy.spiders.Spider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.namespaces">namespaces (scrapy.spiders.XMLFeedSpider 属性)</a>
</li>
      <li>
    NEWSPIDER_MODULE

      <ul>
        <li><a href="topics/settings.html#std-setting-NEWSPIDER_MODULE">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.NoReferrerPolicy">NoReferrerPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.NoReferrerWhenDowngradePolicy">NoReferrerWhenDowngradePolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.NotConfigured">NotConfigured</a>
</li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.NotSupported">NotSupported</a>
</li>
  </ul></td>
</tr></table>

<h2 id="O">O</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/leaks.html#scrapy.utils.trackref.object_ref">object_ref (scrapy.utils.trackref 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.offsite.OffsiteMiddleware">OffsiteMiddleware (scrapy.spidermiddlewares.offsite 中的类)</a>
</li>
      <li><a href="topics/item-pipeline.html#open_spider">open_spider()</a>

      <ul>
        <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.CacheStorage.open_spider">(scrapy.extensions.httpcache.CacheStorage 方法)</a>
</li>
        <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.open_spider">(scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.OriginPolicy">OriginPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.OriginWhenCrossOriginPolicy">OriginWhenCrossOriginPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="P">P</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    parse

      <ul>
        <li><a href="topics/commands.html#std-command-parse">command</a>
</li>
      </ul></li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.parse">parse() (scrapy.spiders.Spider 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.parse_node">parse_node() (scrapy.spiders.XMLFeedSpider 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.CSVFeedSpider.parse_row">parse_row() (scrapy.spiders.CSVFeedSpider 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.CrawlSpider.parse_start_url">parse_start_url() (scrapy.spiders.CrawlSpider 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.PickleItemExporter">PickleItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.contracts.Contract.post_process">post_process() (scrapy.contracts.Contract 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.PprintItemExporter">PprintItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.contracts.Contract.pre_process">pre_process() (scrapy.contracts.Contract 方法)</a>
</li>
      <li><a href="topics/leaks.html#scrapy.utils.trackref.print_live_refs">print_live_refs() (在 scrapy.utils.trackref 模块中)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.DownloaderMiddleware.process_exception">process_exception() (scrapy.downloadermiddlewares.DownloaderMiddleware 方法)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/item-pipeline.html#process_item">process_item()</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.DownloaderMiddleware.process_request">process_request() (scrapy.downloadermiddlewares.DownloaderMiddleware 方法)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.DownloaderMiddleware.process_response">process_response() (scrapy.downloadermiddlewares.DownloaderMiddleware 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider.process_results">process_results() (scrapy.spiders.XMLFeedSpider 方法)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware.process_spider_exception">process_spider_exception() (scrapy.spidermiddlewares.SpiderMiddleware 方法)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware.process_spider_input">process_spider_input() (scrapy.spidermiddlewares.SpiderMiddleware 方法)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware.process_spider_output">process_spider_output() (scrapy.spidermiddlewares.SpiderMiddleware 方法)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware.process_start_requests">process_start_requests() (scrapy.spidermiddlewares.SpiderMiddleware 方法)</a>
</li>
      <li>
    proxy

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-proxy">reqmeta</a>
</li>
      </ul></li>
      <li>
    Python 提高建议

      <ul>
        <li><a href="contributing.html#index-4">PEP 8</a>, <a href="contributing.html#index-5">[1]</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="Q">Q</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spiders.html#scrapy.spiders.CSVFeedSpider.quotechar">quotechar (scrapy.spiders.CSVFeedSpider 属性)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="R">R</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    RANDOMIZE_DOWNLOAD_DELAY

      <ul>
        <li><a href="topics/settings.html#std-setting-RANDOMIZE_DOWNLOAD_DELAY">setting</a>
</li>
      </ul></li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.re">re() (scrapy.selector.Selector 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.re">(scrapy.selector.SelectorList 方法)</a>
</li>
      </ul></li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.re_first">re_first() (scrapy.selector.Selector 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.re_first">(scrapy.selector.SelectorList 方法)</a>
</li>
      </ul></li>
      <li>
    REACTOR_THREADPOOL_MAXSIZE

      <ul>
        <li><a href="topics/settings.html#std-setting-REACTOR_THREADPOOL_MAXSIZE">setting</a>
</li>
      </ul></li>
      <li>
    REDIRECT_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-REDIRECT_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    REDIRECT_MAX_TIMES

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-REDIRECT_MAX_TIMES">setting</a>
</li>
      </ul></li>
      <li>
    REDIRECT_PRIORITY_ADJUST

      <ul>
        <li><a href="topics/settings.html#std-setting-REDIRECT_PRIORITY_ADJUST">setting</a>
</li>
      </ul></li>
      <li>
    redirect_reasons

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-redirect_reasons">reqmeta</a>
</li>
      </ul></li>
      <li>
    redirect_urls

      <ul>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-redirect_urls">reqmeta</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.redirect.RedirectMiddleware">RedirectMiddleware (scrapy.downloadermiddlewares.redirect 中的类)</a>
</li>
      <li>
    REFERER_ENABLED

      <ul>
        <li><a href="topics/spider-middleware.html#std-setting-REFERER_ENABLED">setting</a>
</li>
      </ul></li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.RefererMiddleware">RefererMiddleware (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li>
    REFERRER_POLICY

      <ul>
        <li><a href="topics/spider-middleware.html#std-setting-REFERRER_POLICY">setting</a>
</li>
      </ul></li>
      <li>
    referrer_policy

      <ul>
        <li><a href="topics/spider-middleware.html#std-reqmeta-referrer_policy">reqmeta</a>
</li>
      </ul></li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.register_namespace">register_namespace() (scrapy.selector.Selector 方法)</a>
</li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector.remove_namespaces">remove_namespaces() (scrapy.selector.Selector 方法)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Request.replace">replace() (scrapy.http.Request 方法)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.replace">(scrapy.http.Response 方法)</a>
</li>
      </ul></li>
      <li>
    reqmeta

      <ul>
        <li><a href="topics/request-response.html#std-reqmeta-bindaddress">bindaddress</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-cookiejar">cookiejar</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_cache">dont_cache</a>
</li>
        <li><a href="topics/request-response.html#std-reqmeta-dont_merge_cookies">dont_merge_cookies</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_obey_robotstxt">dont_obey_robotstxt</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_redirect">dont_redirect</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-dont_retry">dont_retry</a>
</li>
        <li><a href="topics/request-response.html#std-reqmeta-download_fail_on_dataloss">download_fail_on_dataloss</a>
</li>
        <li><a href="topics/request-response.html#std-reqmeta-download_latency">download_latency</a>
</li>
        <li><a href="topics/settings.html#std-reqmeta-download_maxsize">download_maxsize</a>
</li>
        <li><a href="topics/request-response.html#std-reqmeta-download_timeout">download_timeout</a>
</li>
        <li><a href="topics/settings.html#std-reqmeta-ftp_password">ftp_password</a>
</li>
        <li><a href="topics/settings.html#std-reqmeta-ftp_user">ftp_user</a>
</li>
        <li><a href="topics/spider-middleware.html#std-reqmeta-handle_httpstatus_all">handle_httpstatus_all</a>
</li>
        <li><a href="topics/spider-middleware.html#std-reqmeta-handle_httpstatus_list">handle_httpstatus_list</a>
</li>
        <li><a href="topics/request-response.html#std-reqmeta-max_retry_times">max_retry_times</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-proxy">proxy</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-redirect_reasons">redirect_reasons</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-reqmeta-redirect_urls">redirect_urls</a>
</li>
        <li><a href="topics/spider-middleware.html#std-reqmeta-referrer_policy">referrer_policy</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/request-response.html#scrapy.http.Request">Request (scrapy.http 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response.request">request (scrapy.http.Response 属性)</a>
</li>
      <li>
    request_dropped

      <ul>
        <li><a href="topics/signals.html#std-signal-request_dropped">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.request_dropped">request_dropped() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    request_left_downloader

      <ul>
        <li><a href="topics/signals.html#std-signal-request_left_downloader">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.request_left_downloader">request_left_downloader() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    request_reached_downloader

      <ul>
        <li><a href="topics/signals.html#std-signal-request_reached_downloader">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.request_reached_downloader">request_reached_downloader() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    request_scheduled

      <ul>
        <li><a href="topics/signals.html#std-signal-request_scheduled">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.request_scheduled">request_scheduled() (在 scrapy.signals 模块中)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response">Response (scrapy.http 中的类)</a>
</li>
      <li>
    response_downloaded

      <ul>
        <li><a href="topics/signals.html#std-signal-response_downloaded">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.response_downloaded">response_downloaded() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    response_received

      <ul>
        <li><a href="topics/signals.html#std-signal-response_received">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.response_received">response_received() (在 scrapy.signals 模块中)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.CacheStorage.retrieve_response">retrieve_response() (scrapy.extensions.httpcache.CacheStorage 方法)</a>
</li>
      <li>
    RETRY_ENABLED

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    RETRY_HTTP_CODES

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_HTTP_CODES">setting</a>
</li>
      </ul></li>
      <li>
    RETRY_PRIORITY_ADJUST

      <ul>
        <li><a href="topics/settings.html#std-setting-RETRY_PRIORITY_ADJUST">setting</a>
</li>
      </ul></li>
      <li>
    RETRY_TIMES

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_TIMES">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.retry.RetryMiddleware">RetryMiddleware (scrapy.downloadermiddlewares.retry 中的类)</a>
</li>
      <li><a href="topics/contracts.html#scrapy.contracts.default.ReturnsContract">ReturnsContract (scrapy.contracts.default 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.RFC2616Policy">RFC2616Policy (scrapy.extensions.httpcache 中的类)</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.robotstxt.RobotParser">RobotParser (scrapy.robotstxt 中的类)</a>
</li>
      <li>
    ROBOTSTXT_OBEY

      <ul>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_OBEY">setting</a>
</li>
      </ul></li>
      <li>
    ROBOTSTXT_PARSER

      <ul>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_PARSER">setting</a>
</li>
      </ul></li>
      <li>
    ROBOTSTXT_USER_AGENT

      <ul>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_USER_AGENT">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware">RobotsTxtMiddleware (scrapy.downloadermiddlewares.robotstxt 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Rule">Rule (scrapy.spiders 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.CrawlSpider.rules">rules (scrapy.spiders.CrawlSpider 属性)</a>
</li>
      <li>
    runspider

      <ul>
        <li><a href="topics/commands.html#std-command-runspider">command</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="S">S</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.SameOriginPolicy">SameOriginPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li>
    SCHEDULER

      <ul>
        <li><a href="topics/settings.html#std-setting-SCHEDULER">setting</a>
</li>
      </ul></li>
      <li>
    SCHEDULER_DEBUG

      <ul>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_DEBUG">setting</a>
</li>
      </ul></li>
      <li>
    SCHEDULER_DISK_QUEUE

      <ul>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_DISK_QUEUE">setting</a>
</li>
      </ul></li>
      <li>
    SCHEDULER_MEMORY_QUEUE

      <ul>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_MEMORY_QUEUE">setting</a>
</li>
      </ul></li>
      <li>
    SCHEDULER_PRIORITY_QUEUE

      <ul>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_PRIORITY_QUEUE">setting</a>
</li>
      </ul></li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.scraped">scraped() (scrapy.logformatter.LogFormatter 方法)</a>
</li>
      <li>
    SCRAPER_SLOT_MAX_ACTIVE_SIZE

      <ul>
        <li><a href="topics/settings.html#std-setting-SCRAPER_SLOT_MAX_ACTIVE_SIZE">setting</a>
</li>
      </ul></li>
      <li><a href="topics/contracts.html#scrapy.contracts.default.ScrapesContract">ScrapesContract (scrapy.contracts.default 中的类)</a>
</li>
      <li>
    scrapy.contracts

      <ul>
        <li><a href="topics/contracts.html#module-scrapy.contracts">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.contracts.default

      <ul>
        <li><a href="topics/contracts.html#module-scrapy.contracts.default">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.crawler

      <ul>
        <li><a href="topics/api.html#module-scrapy.crawler">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.ajaxcrawl

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.ajaxcrawl">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.cookies

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.cookies">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.defaultheaders

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.defaultheaders">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.downloadtimeout

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.downloadtimeout">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.httpauth

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauth">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.httpcache

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpcache">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.httpcompression

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpcompression">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.httpproxy

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpproxy">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.redirect

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.redirect">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.retry

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.retry">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.robotstxt

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.robotstxt">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.stats

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.stats">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.downloadermiddlewares.useragent

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.useragent">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.exceptions

      <ul>
        <li><a href="topics/exceptions.html#module-scrapy.exceptions">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.exporters

      <ul>
        <li><a href="topics/exporters.html#module-scrapy.exporters">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.closespider

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.closespider">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.corestats

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.corestats">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.debug

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.debug">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.httpcache

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.extensions.httpcache">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.logstats

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.logstats">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.memdebug

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.memdebug">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.memusage

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.memusage">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.statsmailer

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.statsmailer">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.extensions.telnet

      <ul>
        <li><a href="topics/extensions.html#module-scrapy.extensions.telnet">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.http

      <ul>
        <li><a href="topics/request-response.html#module-scrapy.http">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.item

      <ul>
        <li><a href="topics/items.html#module-scrapy.item">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.link

      <ul>
        <li><a href="topics/link-extractors.html#module-scrapy.link">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.linkextractors

      <ul>
        <li><a href="topics/link-extractors.html#module-scrapy.linkextractors">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.linkextractors.lxmlhtml

      <ul>
        <li><a href="topics/link-extractors.html#module-scrapy.linkextractors.lxmlhtml">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.loader

      <ul>
        <li><a href="topics/loaders.html#module-scrapy.loader">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.mail

      <ul>
        <li><a href="topics/email.html#module-scrapy.mail">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.pipelines.files

      <ul>
        <li><a href="topics/media-pipeline.html#module-scrapy.pipelines.files">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.pipelines.images

      <ul>
        <li><a href="topics/media-pipeline.html#module-scrapy.pipelines.images">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.robotstxt

      <ul>
        <li><a href="topics/downloader-middleware.html#module-scrapy.robotstxt">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.selector

      <ul>
        <li><a href="topics/selectors.html#module-scrapy.selector">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.settings

      <ul>
        <li><a href="topics/api.html#module-scrapy.settings">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.signals

      <ul>
        <li><a href="topics/signals.html#module-scrapy.signals">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spiderloader

      <ul>
        <li><a href="topics/api.html#module-scrapy.spiderloader">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares.depth

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.depth">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares.httperror

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.httperror">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares.offsite

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.offsite">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares.referer

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.referer">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spidermiddlewares.urllength

      <ul>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.urllength">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.spiders

      <ul>
        <li><a href="topics/spiders.html#module-scrapy.spiders">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.statscollectors

      <ul>
        <li><a href="topics/api.html#module-scrapy.statscollectors">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.utils.log

      <ul>
        <li><a href="topics/logging.html#module-scrapy.utils.log">模块</a>
</li>
      </ul></li>
      <li>
    scrapy.utils.trackref

      <ul>
        <li><a href="topics/leaks.html#module-scrapy.utils.trackref">模块</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse.selector">selector (scrapy.http.TextResponse 属性)</a>
</li>
      <li><a href="topics/selectors.html#scrapy.selector.Selector">Selector (scrapy.selector 中的类)</a>
</li>
      <li><a href="topics/selectors.html#scrapy.selector.SelectorList">SelectorList (scrapy.selector 中的类)</a>
</li>
      <li><a href="topics/email.html#scrapy.mail.MailSender.send">send() (scrapy.mail.MailSender 方法)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.serialize_field">serialize_field() (scrapy.exporters.BaseItemExporter 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.set">set() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.set_stats">set_stats() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector.set_value">set_value() (scrapy.statscollectors.StatsCollector 方法)</a>
</li>
      <li><a href="topics/selectors.html#parsel.xpathfuncs.set_xpathfunc">set_xpathfunc() (在 parsel.xpathfuncs 模块中)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.setmodule">setmodule() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li>
    setting

      <ul>
        <li><a href="topics/downloader-middleware.html#std-setting-AJAXCRAWL_ENABLED">AJAXCRAWL_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-ASYNCIO_EVENT_LOOP">ASYNCIO_EVENT_LOOP</a>
</li>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_DEBUG">AUTOTHROTTLE_DEBUG</a>
</li>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_ENABLED">AUTOTHROTTLE_ENABLED</a>
</li>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_MAX_DELAY">AUTOTHROTTLE_MAX_DELAY</a>
</li>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_START_DELAY">AUTOTHROTTLE_START_DELAY</a>
</li>
        <li><a href="topics/autothrottle.html#std-setting-AUTOTHROTTLE_TARGET_CONCURRENCY">AUTOTHROTTLE_TARGET_CONCURRENCY</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_ACCESS_KEY_ID">AWS_ACCESS_KEY_ID</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_ENDPOINT_URL">AWS_ENDPOINT_URL</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_REGION_NAME">AWS_REGION_NAME</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_SECRET_ACCESS_KEY">AWS_SECRET_ACCESS_KEY</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_USE_SSL">AWS_USE_SSL</a>
</li>
        <li><a href="topics/settings.html#std-setting-AWS_VERIFY">AWS_VERIFY</a>
</li>
        <li><a href="topics/settings.html#std-setting-BOT_NAME">BOT_NAME</a>
</li>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_ERRORCOUNT">CLOSESPIDER_ERRORCOUNT</a>
</li>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_ITEMCOUNT">CLOSESPIDER_ITEMCOUNT</a>
</li>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_PAGECOUNT">CLOSESPIDER_PAGECOUNT</a>
</li>
        <li><a href="topics/extensions.html#std-setting-CLOSESPIDER_TIMEOUT">CLOSESPIDER_TIMEOUT</a>
</li>
        <li><a href="topics/commands.html#std-setting-COMMANDS_MODULE">COMMANDS_MODULE</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-COMPRESSION_ENABLED">COMPRESSION_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_ITEMS">CONCURRENT_ITEMS</a>
</li>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS">CONCURRENT_REQUESTS</a>
</li>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS_PER_DOMAIN">CONCURRENT_REQUESTS_PER_DOMAIN</a>
</li>
        <li><a href="topics/settings.html#std-setting-CONCURRENT_REQUESTS_PER_IP">CONCURRENT_REQUESTS_PER_IP</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-COOKIES_DEBUG">COOKIES_DEBUG</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-COOKIES_ENABLED">COOKIES_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-DEFAULT_ITEM_CLASS">DEFAULT_ITEM_CLASS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DEFAULT_REQUEST_HEADERS">DEFAULT_REQUEST_HEADERS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DEPTH_LIMIT">DEPTH_LIMIT</a>
</li>
        <li><a href="topics/settings.html#std-setting-DEPTH_PRIORITY">DEPTH_PRIORITY</a>
</li>
        <li><a href="topics/settings.html#std-setting-DEPTH_STATS_VERBOSE">DEPTH_STATS_VERBOSE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DNS_RESOLVER">DNS_RESOLVER</a>
</li>
        <li><a href="topics/settings.html#std-setting-DNS_TIMEOUT">DNS_TIMEOUT</a>
</li>
        <li><a href="topics/settings.html#std-setting-DNSCACHE_ENABLED">DNSCACHE_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-DNSCACHE_SIZE">DNSCACHE_SIZE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_DELAY">DOWNLOAD_DELAY</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_FAIL_ON_DATALOSS">DOWNLOAD_FAIL_ON_DATALOSS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_HANDLERS">DOWNLOAD_HANDLERS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_HANDLERS_BASE">DOWNLOAD_HANDLERS_BASE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_MAXSIZE">DOWNLOAD_MAXSIZE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_TIMEOUT">DOWNLOAD_TIMEOUT</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOAD_WARNSIZE">DOWNLOAD_WARNSIZE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER">DOWNLOADER</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_CIPHERS">DOWNLOADER_CLIENT_TLS_CIPHERS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_METHOD">DOWNLOADER_CLIENT_TLS_METHOD</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING">DOWNLOADER_CLIENT_TLS_VERBOSE_LOGGING</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_CLIENTCONTEXTFACTORY">DOWNLOADER_CLIENTCONTEXTFACTORY</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_HTTPCLIENTFACTORY">DOWNLOADER_HTTPCLIENTFACTORY</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_MIDDLEWARES">DOWNLOADER_MIDDLEWARES</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_MIDDLEWARES_BASE">DOWNLOADER_MIDDLEWARES_BASE</a>
</li>
        <li><a href="topics/settings.html#std-setting-DOWNLOADER_STATS">DOWNLOADER_STATS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DUPEFILTER_CLASS">DUPEFILTER_CLASS</a>
</li>
        <li><a href="topics/settings.html#std-setting-DUPEFILTER_DEBUG">DUPEFILTER_DEBUG</a>
</li>
        <li><a href="topics/settings.html#std-setting-EDITOR">EDITOR</a>
</li>
        <li><a href="topics/settings.html#std-setting-EXTENSIONS">EXTENSIONS</a>
</li>
        <li><a href="topics/settings.html#std-setting-EXTENSIONS_BASE">EXTENSIONS_BASE</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_BATCH_ITEM_COUNT">FEED_EXPORT_BATCH_ITEM_COUNT</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_ENCODING">FEED_EXPORT_ENCODING</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_FIELDS">FEED_EXPORT_FIELDS</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORT_INDENT">FEED_EXPORT_INDENT</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORTERS">FEED_EXPORTERS</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_EXPORTERS_BASE">FEED_EXPORTERS_BASE</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGE_FTP_ACTIVE">FEED_STORAGE_FTP_ACTIVE</a>
</li>
        <li><a href="topics/settings.html#std-setting-FEED_STORAGE_GCS_ACL">FEED_STORAGE_GCS_ACL</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGE_S3_ACL">FEED_STORAGE_S3_ACL</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGES">FEED_STORAGES</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORAGES_BASE">FEED_STORAGES_BASE</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_STORE_EMPTY">FEED_STORE_EMPTY</a>
</li>
        <li><a href="topics/settings.html#std-setting-FEED_TEMPDIR">FEED_TEMPDIR</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEED_URI_PARAMS">FEED_URI_PARAMS</a>
</li>
        <li><a href="topics/feed-exports.html#std-setting-FEEDS">FEEDS</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_EXPIRES">FILES_EXPIRES</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_RESULT_FIELD">FILES_RESULT_FIELD</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE">FILES_STORE</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE_GCS_ACL">FILES_STORE_GCS_ACL</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_STORE_S3_ACL">FILES_STORE_S3_ACL</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-FILES_URLS_FIELD">FILES_URLS_FIELD</a>
</li>
        <li><a href="topics/settings.html#std-setting-FTP_PASSIVE_MODE">FTP_PASSIVE_MODE</a>
</li>
        <li><a href="topics/settings.html#std-setting-FTP_PASSWORD">FTP_PASSWORD</a>
</li>
        <li><a href="topics/settings.html#std-setting-FTP_USER">FTP_USER</a>
</li>
        <li><a href="topics/settings.html#std-setting-GCS_PROJECT_ID">GCS_PROJECT_ID</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_ALWAYS_STORE">HTTPCACHE_ALWAYS_STORE</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_DBM_MODULE">HTTPCACHE_DBM_MODULE</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_DIR">HTTPCACHE_DIR</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_ENABLED">HTTPCACHE_ENABLED</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_EXPIRATION_SECS">HTTPCACHE_EXPIRATION_SECS</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_GZIP">HTTPCACHE_GZIP</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_HTTP_CODES">HTTPCACHE_IGNORE_HTTP_CODES</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_MISSING">HTTPCACHE_IGNORE_MISSING</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS">HTTPCACHE_IGNORE_RESPONSE_CACHE_CONTROLS</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_IGNORE_SCHEMES">HTTPCACHE_IGNORE_SCHEMES</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_POLICY">HTTPCACHE_POLICY</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPCACHE_STORAGE">HTTPCACHE_STORAGE</a>
</li>
        <li><a href="topics/spider-middleware.html#std-setting-HTTPERROR_ALLOW_ALL">HTTPERROR_ALLOW_ALL</a>
</li>
        <li><a href="topics/spider-middleware.html#std-setting-HTTPERROR_ALLOWED_CODES">HTTPERROR_ALLOWED_CODES</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPPROXY_AUTH_ENCODING">HTTPPROXY_AUTH_ENCODING</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-HTTPPROXY_ENABLED">HTTPPROXY_ENABLED</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_EXPIRES">IMAGES_EXPIRES</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_MIN_HEIGHT">IMAGES_MIN_HEIGHT</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_MIN_WIDTH">IMAGES_MIN_WIDTH</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_RESULT_FIELD">IMAGES_RESULT_FIELD</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE">IMAGES_STORE</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE_GCS_ACL">IMAGES_STORE_GCS_ACL</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_STORE_S3_ACL">IMAGES_STORE_S3_ACL</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_THUMBS">IMAGES_THUMBS</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-IMAGES_URLS_FIELD">IMAGES_URLS_FIELD</a>
</li>
        <li><a href="topics/settings.html#std-setting-ITEM_PIPELINES">ITEM_PIPELINES</a>
</li>
        <li><a href="topics/settings.html#std-setting-ITEM_PIPELINES_BASE">ITEM_PIPELINES_BASE</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_DATEFORMAT">LOG_DATEFORMAT</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_ENABLED">LOG_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_ENCODING">LOG_ENCODING</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_FILE">LOG_FILE</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_FORMAT">LOG_FORMAT</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_FORMATTER">LOG_FORMATTER</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_LEVEL">LOG_LEVEL</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_SHORT_NAMES">LOG_SHORT_NAMES</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOG_STDOUT">LOG_STDOUT</a>
</li>
        <li><a href="topics/settings.html#std-setting-LOGSTATS_INTERVAL">LOGSTATS_INTERVAL</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_FROM">MAIL_FROM</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_HOST">MAIL_HOST</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_PASS">MAIL_PASS</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_PORT">MAIL_PORT</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_SSL">MAIL_SSL</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_TLS">MAIL_TLS</a>
</li>
        <li><a href="topics/email.html#std-setting-MAIL_USER">MAIL_USER</a>
</li>
        <li><a href="topics/media-pipeline.html#std-setting-MEDIA_ALLOW_REDIRECTS">MEDIA_ALLOW_REDIRECTS</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMDEBUG_ENABLED">MEMDEBUG_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMDEBUG_NOTIFY">MEMDEBUG_NOTIFY</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_CHECK_INTERVAL_SECONDS">MEMUSAGE_CHECK_INTERVAL_SECONDS</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_ENABLED">MEMUSAGE_ENABLED</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_LIMIT_MB">MEMUSAGE_LIMIT_MB</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_NOTIFY_MAIL">MEMUSAGE_NOTIFY_MAIL</a>
</li>
        <li><a href="topics/settings.html#std-setting-MEMUSAGE_WARNING_MB">MEMUSAGE_WARNING_MB</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_ENABLED">METAREFRESH_ENABLED</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_IGNORE_TAGS">METAREFRESH_IGNORE_TAGS</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-METAREFRESH_MAXDELAY">METAREFRESH_MAXDELAY</a>
</li>
        <li><a href="topics/settings.html#std-setting-NEWSPIDER_MODULE">NEWSPIDER_MODULE</a>
</li>
        <li><a href="topics/settings.html#std-setting-RANDOMIZE_DOWNLOAD_DELAY">RANDOMIZE_DOWNLOAD_DELAY</a>
</li>
        <li><a href="topics/settings.html#std-setting-REACTOR_THREADPOOL_MAXSIZE">REACTOR_THREADPOOL_MAXSIZE</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-REDIRECT_ENABLED">REDIRECT_ENABLED</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-REDIRECT_MAX_TIMES">REDIRECT_MAX_TIMES</a>
</li>
        <li><a href="topics/settings.html#std-setting-REDIRECT_PRIORITY_ADJUST">REDIRECT_PRIORITY_ADJUST</a>
</li>
        <li><a href="topics/spider-middleware.html#std-setting-REFERER_ENABLED">REFERER_ENABLED</a>
</li>
        <li><a href="topics/spider-middleware.html#std-setting-REFERRER_POLICY">REFERRER_POLICY</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_ENABLED">RETRY_ENABLED</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_HTTP_CODES">RETRY_HTTP_CODES</a>
</li>
        <li><a href="topics/settings.html#std-setting-RETRY_PRIORITY_ADJUST">RETRY_PRIORITY_ADJUST</a>
</li>
        <li><a href="topics/downloader-middleware.html#std-setting-RETRY_TIMES">RETRY_TIMES</a>
</li>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_OBEY">ROBOTSTXT_OBEY</a>
</li>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_PARSER">ROBOTSTXT_PARSER</a>
</li>
        <li><a href="topics/settings.html#std-setting-ROBOTSTXT_USER_AGENT">ROBOTSTXT_USER_AGENT</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCHEDULER">SCHEDULER</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_DEBUG">SCHEDULER_DEBUG</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_DISK_QUEUE">SCHEDULER_DISK_QUEUE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_MEMORY_QUEUE">SCHEDULER_MEMORY_QUEUE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCHEDULER_PRIORITY_QUEUE">SCHEDULER_PRIORITY_QUEUE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SCRAPER_SLOT_MAX_ACTIVE_SIZE">SCRAPER_SLOT_MAX_ACTIVE_SIZE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_CONTRACTS">SPIDER_CONTRACTS</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_CONTRACTS_BASE">SPIDER_CONTRACTS_BASE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_LOADER_CLASS">SPIDER_LOADER_CLASS</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_LOADER_WARN_ONLY">SPIDER_LOADER_WARN_ONLY</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_MIDDLEWARES">SPIDER_MIDDLEWARES</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_MIDDLEWARES_BASE">SPIDER_MIDDLEWARES_BASE</a>
</li>
        <li><a href="topics/settings.html#std-setting-SPIDER_MODULES">SPIDER_MODULES</a>
</li>
        <li><a href="topics/settings.html#std-setting-STATS_CLASS">STATS_CLASS</a>
</li>
        <li><a href="topics/settings.html#std-setting-STATS_DUMP">STATS_DUMP</a>
</li>
        <li><a href="topics/settings.html#std-setting-STATSMAILER_RCPTS">STATSMAILER_RCPTS</a>
</li>
        <li><a href="topics/settings.html#std-setting-TELNETCONSOLE_ENABLED">TELNETCONSOLE_ENABLED</a>
</li>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_HOST">TELNETCONSOLE_HOST</a>
</li>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_PASSWORD">TELNETCONSOLE_PASSWORD</a>
</li>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_PORT">TELNETCONSOLE_PORT</a>
</li>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_USERNAME">TELNETCONSOLE_USERNAME</a>
</li>
        <li><a href="topics/settings.html#std-setting-TEMPLATES_DIR">TEMPLATES_DIR</a>
</li>
        <li><a href="topics/settings.html#std-setting-TWISTED_REACTOR">TWISTED_REACTOR</a>
</li>
        <li><a href="topics/settings.html#std-setting-URLLENGTH_LIMIT">URLLENGTH_LIMIT</a>
</li>
        <li><a href="topics/settings.html#std-setting-USER_AGENT">USER_AGENT</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    settings

      <ul>
        <li><a href="topics/commands.html#std-command-settings">command</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.settings">settings (scrapy.crawler.Crawler 属性)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.Settings">Settings (scrapy.settings 中的类)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.settings">settings (scrapy.spiders.Spider 属性)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.SETTINGS_PRIORITIES">SETTINGS_PRIORITIES() (在 scrapy.settings 模块中)</a>
</li>
      <li>
    shell

      <ul>
        <li><a href="topics/commands.html#std-command-shell">command</a>
</li>
      </ul></li>
      <li>
    signal

      <ul>
        <li><a href="topics/signals.html#std-signal-bytes_received">bytes_received</a>
</li>
        <li><a href="topics/signals.html#std-signal-engine_started">engine_started</a>
</li>
        <li><a href="topics/signals.html#std-signal-engine_stopped">engine_stopped</a>
</li>
        <li><a href="topics/signals.html#std-signal-item_dropped">item_dropped</a>
</li>
        <li><a href="topics/signals.html#std-signal-item_error">item_error</a>
</li>
        <li><a href="topics/signals.html#std-signal-item_scraped">item_scraped</a>
</li>
        <li><a href="topics/signals.html#std-signal-request_dropped">request_dropped</a>
</li>
        <li><a href="topics/signals.html#std-signal-request_left_downloader">request_left_downloader</a>
</li>
        <li><a href="topics/signals.html#std-signal-request_reached_downloader">request_reached_downloader</a>
</li>
        <li><a href="topics/signals.html#std-signal-request_scheduled">request_scheduled</a>
</li>
        <li><a href="topics/signals.html#std-signal-response_downloaded">response_downloaded</a>
</li>
        <li><a href="topics/signals.html#std-signal-response_received">response_received</a>
</li>
        <li><a href="topics/signals.html#std-signal-spider_closed">spider_closed</a>
</li>
        <li><a href="topics/signals.html#std-signal-spider_error">spider_error</a>
</li>
        <li><a href="topics/signals.html#std-signal-spider_idle">spider_idle</a>
</li>
        <li><a href="topics/signals.html#std-signal-spider_opened">spider_opened</a>
</li>
        <li><a href="topics/telnetconsole.html#std-signal-update_telnet_vars">update_telnet_vars</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.signals">signals (scrapy.crawler.Crawler 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider.sitemap_alternate_links">sitemap_alternate_links (scrapy.spiders.SitemapSpider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider.sitemap_filter">sitemap_filter() (scrapy.spiders.SitemapSpider 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider.sitemap_follow">sitemap_follow (scrapy.spiders.SitemapSpider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider.sitemap_rules">sitemap_rules (scrapy.spiders.SitemapSpider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider.sitemap_urls">sitemap_urls (scrapy.spiders.SitemapSpider 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.SitemapSpider">SitemapSpider (scrapy.spiders 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.spider">spider (scrapy.crawler.Crawler 属性)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider">Spider (scrapy.spiders 中的类)</a>
</li>
      <li>
    spider_closed

      <ul>
        <li><a href="topics/signals.html#std-signal-spider_closed">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.spider_closed">spider_closed() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    SPIDER_CONTRACTS

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_CONTRACTS">setting</a>
</li>
      </ul></li>
      <li>
    SPIDER_CONTRACTS_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_CONTRACTS_BASE">setting</a>
</li>
      </ul></li>
      <li>
    spider_error

      <ul>
        <li><a href="topics/signals.html#std-signal-spider_error">signal</a>
</li>
      </ul></li>
      <li><a href="topics/logging.html#scrapy.logformatter.LogFormatter.spider_error">spider_error() (scrapy.logformatter.LogFormatter 方法)</a>

      <ul>
        <li><a href="topics/signals.html#scrapy.signals.spider_error">(在 scrapy.signals 模块中)</a>
</li>
      </ul></li>
      <li>
    spider_idle

      <ul>
        <li><a href="topics/signals.html#std-signal-spider_idle">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.spider_idle">spider_idle() (在 scrapy.signals 模块中)</a>
</li>
      <li>
    SPIDER_LOADER_CLASS

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_LOADER_CLASS">setting</a>
</li>
      </ul></li>
      <li>
    SPIDER_LOADER_WARN_ONLY

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_LOADER_WARN_ONLY">setting</a>
</li>
      </ul></li>
      <li>
    SPIDER_MIDDLEWARES

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_MIDDLEWARES">setting</a>
</li>
      </ul></li>
      <li>
    SPIDER_MIDDLEWARES_BASE

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_MIDDLEWARES_BASE">setting</a>
</li>
      </ul></li>
      <li>
    SPIDER_MODULES

      <ul>
        <li><a href="topics/settings.html#std-setting-SPIDER_MODULES">setting</a>
</li>
      </ul></li>
      <li>
    spider_opened

      <ul>
        <li><a href="topics/signals.html#std-signal-spider_opened">signal</a>
</li>
      </ul></li>
      <li><a href="topics/signals.html#scrapy.signals.spider_opened">spider_opened() (在 scrapy.signals 模块中)</a>
</li>
      <li><a href="topics/stats.html#scrapy.statscollectors.MemoryStatsCollector.spider_stats">spider_stats (scrapy.statscollectors.MemoryStatsCollector 属性)</a>
</li>
      <li><a href="topics/api.html#scrapy.spiderloader.SpiderLoader">SpiderLoader (scrapy.spiderloader 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.SpiderMiddleware">SpiderMiddleware (scrapy.spidermiddlewares 中的类)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.debug.StackTraceDump">StackTraceDump (scrapy.extensions.debug 中的类)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.BaseItemExporter.start_exporting">start_exporting() (scrapy.exporters.BaseItemExporter 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.start_requests">start_requests() (scrapy.spiders.Spider 方法)</a>
</li>
      <li><a href="topics/spiders.html#scrapy.spiders.Spider.start_urls">start_urls (scrapy.spiders.Spider 属性)</a>
</li>
      <li>
    startproject

      <ul>
        <li><a href="topics/commands.html#std-command-startproject">command</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.crawler.Crawler.stats">stats (scrapy.crawler.Crawler 属性)</a>
</li>
      <li>
    STATS_CLASS

      <ul>
        <li><a href="topics/settings.html#std-setting-STATS_CLASS">setting</a>
</li>
      </ul></li>
      <li>
    STATS_DUMP

      <ul>
        <li><a href="topics/settings.html#std-setting-STATS_DUMP">setting</a>
</li>
      </ul></li>
      <li><a href="topics/api.html#scrapy.statscollectors.StatsCollector">StatsCollector (scrapy.statscollectors 中的类)</a>
</li>
      <li><a href="topics/extensions.html#scrapy.extensions.statsmailer.StatsMailer">StatsMailer (scrapy.extensions.statsmailer 中的类)</a>
</li>
      <li>
    STATSMAILER_RCPTS

      <ul>
        <li><a href="topics/settings.html#std-setting-STATSMAILER_RCPTS">setting</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.Response.status">status (scrapy.http.Response 属性)</a>
</li>
      <li><a href="topics/exceptions.html#scrapy.exceptions.StopDownload">StopDownload</a>
</li>
      <li><a href="topics/downloader-middleware.html#scrapy.extensions.httpcache.CacheStorage.store_response">store_response() (scrapy.extensions.httpcache.CacheStorage 方法)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.StrictOriginPolicy">StrictOriginPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.StrictOriginWhenCrossOriginPolicy">StrictOriginWhenCrossOriginPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="T">T</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/extensions.html#scrapy.extensions.telnet.TelnetConsole">TelnetConsole (scrapy.extensions.telnet 中的类)</a>
</li>
      <li>
    TELNETCONSOLE_ENABLED

      <ul>
        <li><a href="topics/settings.html#std-setting-TELNETCONSOLE_ENABLED">setting</a>
</li>
      </ul></li>
      <li>
    TELNETCONSOLE_HOST

      <ul>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_HOST">setting</a>
</li>
      </ul></li>
      <li>
    TELNETCONSOLE_PASSWORD

      <ul>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_PASSWORD">setting</a>
</li>
      </ul></li>
      <li>
    TELNETCONSOLE_PORT

      <ul>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_PORT">setting</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    TELNETCONSOLE_USERNAME

      <ul>
        <li><a href="topics/telnetconsole.html#std-setting-TELNETCONSOLE_USERNAME">setting</a>
</li>
      </ul></li>
      <li>
    TEMPLATES_DIR

      <ul>
        <li><a href="topics/settings.html#std-setting-TEMPLATES_DIR">setting</a>
</li>
      </ul></li>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse.text">text (scrapy.http.TextResponse 属性)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse">TextResponse (scrapy.http 中的类)</a>
</li>
      <li>
    TWISTED_REACTOR

      <ul>
        <li><a href="topics/settings.html#std-setting-TWISTED_REACTOR">setting</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="U">U</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.referer.UnsafeUrlPolicy">UnsafeUrlPolicy (scrapy.spidermiddlewares.referer 中的类)</a>
</li>
      <li><a href="topics/api.html#scrapy.settings.BaseSettings.update">update() (scrapy.settings.BaseSettings 方法)</a>
</li>
      <li>
    update_telnet_vars

      <ul>
        <li><a href="topics/telnetconsole.html#std-signal-update_telnet_vars">signal</a>
</li>
      </ul></li>
      <li><a href="topics/telnetconsole.html#scrapy.extensions.telnet.update_telnet_vars">update_telnet_vars() (在 scrapy.extensions.telnet 模块中)</a>
</li>
      <li><a href="topics/feed-exports.html#scrapy.extensions.feedexport.uri_params">uri_params() (在 scrapy.extensions.feedexport 模块中)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Request.url">url (scrapy.http.Request 属性)</a>

      <ul>
        <li><a href="topics/request-response.html#scrapy.http.Response.url">(scrapy.http.Response 属性)</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/contracts.html#scrapy.contracts.default.UrlContract">UrlContract (scrapy.contracts.default 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.Response.urljoin">urljoin() (scrapy.http.Response 方法)</a>
</li>
      <li>
    URLLENGTH_LIMIT

      <ul>
        <li><a href="topics/settings.html#std-setting-URLLENGTH_LIMIT">setting</a>
</li>
      </ul></li>
      <li><a href="topics/spider-middleware.html#scrapy.spidermiddlewares.urllength.UrlLengthMiddleware">UrlLengthMiddleware (scrapy.spidermiddlewares.urllength 中的类)</a>
</li>
      <li>
    USER_AGENT

      <ul>
        <li><a href="topics/settings.html#std-setting-USER_AGENT">setting</a>
</li>
      </ul></li>
      <li><a href="topics/downloader-middleware.html#scrapy.downloadermiddlewares.useragent.UserAgentMiddleware">UserAgentMiddleware (scrapy.downloadermiddlewares.useragent 中的类)</a>
</li>
  </ul></td>
</tr></table>

<h2 id="V">V</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    version

      <ul>
        <li><a href="topics/commands.html#std-command-version">command</a>
</li>
      </ul></li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    view

      <ul>
        <li><a href="topics/commands.html#std-command-view">command</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="X">X</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/spiders.html#scrapy.spiders.XMLFeedSpider">XMLFeedSpider (scrapy.spiders 中的类)</a>
</li>
      <li><a href="topics/exporters.html#scrapy.exporters.XmlItemExporter">XmlItemExporter (scrapy.exporters 中的类)</a>
</li>
      <li><a href="topics/request-response.html#scrapy.http.XmlResponse">XmlResponse (scrapy.http 中的类)</a>
</li>
  </ul></td>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li><a href="topics/request-response.html#scrapy.http.TextResponse.xpath">xpath() (scrapy.http.TextResponse 方法)</a>

      <ul>
        <li><a href="topics/selectors.html#scrapy.selector.Selector.xpath">(scrapy.selector.Selector 方法)</a>
</li>
        <li><a href="topics/selectors.html#scrapy.selector.SelectorList.xpath">(scrapy.selector.SelectorList 方法)</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>

<h2 id="模">模</h2>
<table style="width: 100%" class="indextable genindextable"><tr>
  <td style="width: 33%; vertical-align: top;"><ul>
      <li>
    模块

      <ul>
        <li><a href="topics/contracts.html#module-scrapy.contracts">scrapy.contracts</a>
</li>
        <li><a href="topics/contracts.html#module-scrapy.contracts.default">scrapy.contracts.default</a>
</li>
        <li><a href="topics/api.html#module-scrapy.crawler">scrapy.crawler</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares">scrapy.downloadermiddlewares</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.ajaxcrawl">scrapy.downloadermiddlewares.ajaxcrawl</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.cookies">scrapy.downloadermiddlewares.cookies</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.defaultheaders">scrapy.downloadermiddlewares.defaultheaders</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.downloadtimeout">scrapy.downloadermiddlewares.downloadtimeout</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpauth">scrapy.downloadermiddlewares.httpauth</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpcache">scrapy.downloadermiddlewares.httpcache</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpcompression">scrapy.downloadermiddlewares.httpcompression</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.httpproxy">scrapy.downloadermiddlewares.httpproxy</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.redirect">scrapy.downloadermiddlewares.redirect</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.retry">scrapy.downloadermiddlewares.retry</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.robotstxt">scrapy.downloadermiddlewares.robotstxt</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.stats">scrapy.downloadermiddlewares.stats</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.useragent">scrapy.downloadermiddlewares.useragent</a>
</li>
        <li><a href="topics/exceptions.html#module-scrapy.exceptions">scrapy.exceptions</a>
</li>
        <li><a href="topics/exporters.html#module-scrapy.exporters">scrapy.exporters</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.closespider">scrapy.extensions.closespider</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.corestats">scrapy.extensions.corestats</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.debug">scrapy.extensions.debug</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.extensions.httpcache">scrapy.extensions.httpcache</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.logstats">scrapy.extensions.logstats</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.memdebug">scrapy.extensions.memdebug</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.memusage">scrapy.extensions.memusage</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.statsmailer">scrapy.extensions.statsmailer</a>
</li>
        <li><a href="topics/extensions.html#module-scrapy.extensions.telnet">scrapy.extensions.telnet</a>
</li>
        <li><a href="topics/request-response.html#module-scrapy.http">scrapy.http</a>
</li>
        <li><a href="topics/items.html#module-scrapy.item">scrapy.item</a>
</li>
        <li><a href="topics/link-extractors.html#module-scrapy.link">scrapy.link</a>
</li>
        <li><a href="topics/link-extractors.html#module-scrapy.linkextractors">scrapy.linkextractors</a>
</li>
        <li><a href="topics/link-extractors.html#module-scrapy.linkextractors.lxmlhtml">scrapy.linkextractors.lxmlhtml</a>
</li>
        <li><a href="topics/loaders.html#module-scrapy.loader">scrapy.loader</a>
</li>
        <li><a href="topics/email.html#module-scrapy.mail">scrapy.mail</a>
</li>
        <li><a href="topics/media-pipeline.html#module-scrapy.pipelines.files">scrapy.pipelines.files</a>
</li>
        <li><a href="topics/media-pipeline.html#module-scrapy.pipelines.images">scrapy.pipelines.images</a>
</li>
        <li><a href="topics/downloader-middleware.html#module-scrapy.robotstxt">scrapy.robotstxt</a>
</li>
        <li><a href="topics/selectors.html#module-scrapy.selector">scrapy.selector</a>
</li>
        <li><a href="topics/api.html#module-scrapy.settings">scrapy.settings</a>
</li>
        <li><a href="topics/signals.html#module-scrapy.signals">scrapy.signals</a>
</li>
        <li><a href="topics/api.html#module-scrapy.spiderloader">scrapy.spiderloader</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares">scrapy.spidermiddlewares</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.depth">scrapy.spidermiddlewares.depth</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.httperror">scrapy.spidermiddlewares.httperror</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.offsite">scrapy.spidermiddlewares.offsite</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.referer">scrapy.spidermiddlewares.referer</a>
</li>
        <li><a href="topics/spider-middleware.html#module-scrapy.spidermiddlewares.urllength">scrapy.spidermiddlewares.urllength</a>
</li>
        <li><a href="topics/spiders.html#module-scrapy.spiders">scrapy.spiders</a>
</li>
        <li><a href="topics/api.html#module-scrapy.statscollectors">scrapy.statscollectors</a>
</li>
        <li><a href="topics/logging.html#module-scrapy.utils.log">scrapy.utils.log</a>
</li>
        <li><a href="topics/leaks.html#module-scrapy.utils.trackref">scrapy.utils.trackref</a>
</li>
      </ul></li>
  </ul></td>
</tr></table>



           </div>
           
          </div>
          <footer>
  

  <hr/>

  <div role="contentinfo">
    <p>
        
        &copy; 版权所有 2008–2020, Scrapy developers
      <span class="lastupdated">
        最后更新于 10月 18, 2020.
      </span>

    </p>
  </div>
    
    
    
    Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a
    
    <a href="https://github.com/rtfd/sphinx_rtd_theme">theme</a>
    
    provided by <a href="https://readthedocs.org">Read the Docs</a>. 

</footer>

        </div>
      </div>

    </section>

  </div>
  

  <script type="text/javascript">
      jQuery(function () {
          SphinxRtdTheme.Navigation.enable(true);
      });
  </script>

  
  
    
  
 
<script type="text/javascript">
!function(){var analytics=window.analytics=window.analytics||[];if(!analytics.initialize)if(analytics.invoked)window.console&&console.error&&console.error("Segment snippet included twice.");else{analytics.invoked=!0;analytics.methods=["trackSubmit","trackClick","trackLink","trackForm","pageview","identify","reset","group","track","ready","alias","page","once","off","on"];analytics.factory=function(t){return function(){var e=Array.prototype.slice.call(arguments);e.unshift(t);analytics.push(e);return analytics}};for(var t=0;t<analytics.methods.length;t++){var e=analytics.methods[t];analytics[e]=analytics.factory(e)}analytics.load=function(t){var e=document.createElement("script");e.type="text/javascript";e.async=!0;e.src=("https:"===document.location.protocol?"https://":"http://")+"cdn.segment.com/analytics.js/v1/"+t+"/analytics.min.js";var n=document.getElementsByTagName("script")[0];n.parentNode.insertBefore(e,n)};analytics.SNIPPET_VERSION="3.1.0";
analytics.load("8UDQfnf3cyFSTsM4YANnW5sXmgZVILbA");
analytics.page();
}}();

analytics.ready(function () {
    ga('require', 'linker');
    ga('linker:autoLink', ['scrapinghub.com', 'crawlera.com']);
});
</script>


</body>
</html>